INTRINSIC MECHANISM FOR ENTROPY CHANGE IN 
CLASSICAL AND QUANTUM EVOLUTION 

E. Eisenberg 1 and L.P. Horwitz 1,2 
1 Department of Physics, Bar-Ilan University 
Ramat-Gan 52900, Israel. 
2 School of Physics, Raymond and Beverly Sackler Faculty of Exact Sciences 
Tel-Aviv University, Ramat-Aviv, Israel. 



It is shown that the existence of a time operator in the Liouville space represen- 
tation of both classical and quantum evolution provides a mechanism for effective 
entropy change of physical states. In particular, an initially effectively pure state can 
evolve under the usual unitary evolution to an effectively mixed state. 
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I. INTRODUCTION 



The Hamiltonian evolution of states in classical mechanics is known by the Liouville the- 
orem to be non- mixing, i.e., to preserve the entropy of the system []]]. The same property 
holds for the quantum evolution as well, and follows from the unitarity of the evolution 
operator. Thus, in both classical and quantum mechanics, the entropy of a (closed) system 
is rigorously a constant of motion. This has been an obstacle to the consistent description of 
irreversible processes from first principles 0. The usual use of techniques of coarse-graining 
or truncation to achieve a realization of the second law does not follow from basic dynam- 
ical laws, and is fundamentally not consistent with the underlying Hamiltonian dynamical 
structure H 

It is often argued that large systems appear to exhibit irreversible behavior simply be- 
cause it is impossible to observe the precise state of the system [||||||7|] . Thus, a partial 
trace over the not observed degrees of freedom is performed, which leads to an effective 
coarse-graining. However, the exponential decay of a small unstable system, such as an 
atom in an excited state, or an unstable particle (e.g. a neutron), is also not consistent with 
the prediction of the (reversible) Wigner-Weisskopf description of decay systems, which is 
non-exponential at short (and long) times pLBLCT. This short time behavior can be shown 
to be due to the so-called regeneration terms, which would not appear if the description were 



truly irreversible [[T]],|l2|,[n| . It thus appears that the intrinsic reversibility implemented by 
the unitarity of the evolution operator is fundamentally not consistent with the irreversiblity 
which is the basis not only for statistical mechanics, but also for the description of micro- 
scopic unstable systems, and measurement theory. Many attempts have been made in recent 



years to solve this fundamental problem p jl^JT5|J16| Jll 

In this work we study one of the aspects of this problem; we show that the existence 
of a "time" operator T in the framework of Liouville space theory |T1J provides a natural 
and consistent mechanism for which pure states become mixed during the evolution (this 
operator is not the actual time, but is a function on the Liouville measure space which 
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translates linearly with time). The Liouville space is essential for this construction, since a 
time operator does not exist in the usual Hilbert space (for a semi-bounded Hamiltonian). 

The notion of a pure state is defined by means of expectation values of observables, i.e., 
a state is called "pure" if the expectation value of each observable in this state is equal 
to the corresponding expectation value computed with respect to some well-defined wave 
function (defined up to a phase), that is, a density matrix which is a projection operator 
to a one- dimensional subspace. In the following, we consider the subset of a complete 
set of observables defined on the Liouville space which are not explicitly dependent on 
the T-variable. It is shown that this subset corresponds to the experimentally accessible 
observables. One obtains all the physical information concerning this subset of observables 
from an effective state resulting from the reduction of the full state by integration over 
the degree of freedom which is not relevant for this subset, i.e., the spectrum of the time 
operator. We call this reduced state the effective physical state. It is, of course, an old 
technique of statistical mechanics to trace over unmeasured variables to obtain a reduced 
density matrix. We show that the selection of the time variable in the Liouville space 
is natural and appropriate, and provides a natural mechanism for which an initially pure 
effective state can evolve to a mixed one, under the time evolution of the system. We show 
that there exist mixed states for which the effective physical state is pure and denote them 
as effectively pure. These states may become effectively mixed during the evolution of the 
system. We formulate these ideas in the framework of the quantum Liouville space, and 
consider later their application to classical mechanics. We also consider a simple explicit 
example to illustrate this mechanism. 



II. REPRESENTATION IN TERMS OF LIOUVILLE TIME 



It is well known that one cannot define a time-operator T in the usual quantum Hilbert 



space with semi-bounded Hamiltonian |19j ; however, it is possible to define such an operator 



in the framework of Liouville space in which the generator of the evolution is the "Liouvillian" 
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(whose prototype is the commutator with the Hamiltonian) which generally has absolutely 
continuous spectrum on the whole real axis |T7[. It is defined by 



e~ ia p = e - lHt pe iHt , (1) 



and Cq by 



e - iCot p = e - iHot pe iHot . (2) 



Then, Cj = C — Cq. 

The existence of the time-operator has been extensively used in the context of quantum 



statistical mechanics |18| . The kernel representing a Hilbert-Schmidt operator A on the 
original Hilbert space of n degrees of freedom, (k|A|k'), where k consists of n parameters, 
corresponds to the function A(k, k') = (k, k'|A) representing the vector A of the Liouville 
space. We then change variables from k, k' to £, the spectrum of T, and (2n — 1) other 
independent parameters (3. This transformation is defined by a kernel K(£, j3\k, k') such 
that 

AfoP) = (^,(3\A) = J K(Z,{3\k,k>)(k,k>\A)dkdk>. (3) 

In what follows, we shall use the time operator T conjugate to the unperturbed Liouville 
operator £ , which is defined according to the decomposition 

C = C + d, (4) 

i.e., on a suitable domain 

[T,£ ]=i. (5) 

It follows from (|5|) that 

(e-^A^P) = A(t + t,0). (6) 

From (|I|) and (^), we see that if the free Hamiltonian is diagonal in the (generalized) states 
{|k>}, 



K{i + t, /9|k, k') = Kfo (3\k, k')e-^~ E ^\ (7) 

where is the unperturbed energy associated with the variables k, and hence that 

K(£, (3\k, k') = K(0, (3\k, k') e -^k-£ k ,X ( 8 ) 

Under the free evolution, the representation of A on the Liouville space undergoes translation 
£ — > £+t, so that translation in the spectrum of the T-operator of the Liouville space reflects 
the interval of the free evolution. We emphasize that £ is not the time, but a function on the 
manifold of the Liouville space (which does not exist on the manifold of the Hilbert space) , 
and shifts translationally with the time t under free evolution. 

Using this new basis, the expectation value of an observable is written as 

(A) p = Tr(Ap) = J ps((3)A(Z,f3)dtd(3, (9) 

where 

A(£,P) = J K^,(3\k,k')(k,k'\A)dkdk'. (10) 

It follows from Eq. @ that ^-independent observables commute with the free Hamil- 
tonian Hq. In this case, clearly the asymptotic form of the observable A (in Heisenberg 
picture) exists if the wave operator for the scattering theory exists, i.e., 

lim e~ iCt A= lim U(t)- l AU(t) 

= lim Uity'Uo^AUoity'Uit) 

t — »±oo 

= n ± An^ = a±, (ii) 

where U(t) is the full evolution operator, and Uo(t) is that of the unperturbed evolution 
pl| . The ^-independent observables therefore have a correspondence with the asymptotic 
variables in a scattering theory p2 |. Ludwig |^3| has emphasized that measurements on a 



quantum system are made by means of the detection of signals corresponding to observables 
which are operationally on a semi-classical or classical level. These measurable signals, which 



characterize the state are the properties propagating to the detectors, and are therefore 
asymptotic variables, i.e., ^-independent. We do not argue that observables which are time 
dependent in Heisenberg picture (such as the electro-magnetic field) play no role. These 
operators may be even useful for calculations of measurable quantities, and their expectation 
values can be evaluated using, for example, the Schwinger-Keldysh technique EM. However, 
from a physical point of view, based on the above mentioned theoretical arguments on the 
nature of measurement, only functions of these observables which have asymptotic limits (in 
the case of electro-magnetic field, the free number density and the momentum, for example) 
provide for experimental measurement. Measurements carried out upon an evolving system 
involve, in fact, interactions with apparatus which are essentially asymptotic (e.g. magnetic 
fields far from an electron beam, or the e-v or photon signal from the pions in the final state 
of K-meson decay). These asymptotic observables determine the structure of the state, and 
hence (with a sufficient number of such measurements) can be used to define the nature 
of the evolution, i.e., whether a pure state tends to a mixed state. We thus conclude that 
the subset of ^-independent observables corresponds to all the experimentally accessible 
measurements, and is therefore the subset of observables which can be used to characterize 
experimentally the structure of a physical state. 



III. EFFECTIVE STATES 

In view of the ideas presented in the previous section, one sees that since the ^-dependent 
observables are experimentally unmeasurable, they form natural candidates for the reduction 
of the density matrix through integrating over the unmeasurable variables. Note, however, 
that in this version of the reduction scheme the set of unmeasured variables is not chosen 
arbitrarily by specifying the macroscopic measured quantities, but it is rather obtained 
through a fundamental theoretical argument concerning the nature of the measurement 
process. Thus, this reduction does not depend on the choice of the set of variables used 
for the characterization of the physical state in some specific experiment, but is rather 
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determined by the set of all measurable variables. Moreover, this reduction applies to 
unstable microscopic systems as well. 

One thus looks for a partial trace over p, such that the information concerning expectation 
values of all the ^-independent observables can be extracted from the reduced density matrix 
p. We now show that this desired reduction is obtained by integrating p over £. If A belongs 
to the subset of ^-independent operators, i.e., A(£, (3) = A(0), then from Eq. @ it follows 
that 

(A) = Ti(Ap) = J p((3)A((3)dp, (12) 

where p is defined as 

p((3) = J dfo(0) . (13) 

It is therefore clear that with respect to the set of ^-independent observables, all of the 
information available in the state is contained in p. 

We call a state p effectively pure if there exists a wave function ip such that for every 
^-independent observable A 

(i/,\A\i/>) = (A)p = Jp{p)AWP- (14) 

According to the preceding discussion, the expectation value of experimentally measurable 
observables can be predicted in this case by means of a wave-function. Consequently, an 
effectively pure state can not be experimentally distinguished from a state which is described 
by a wave- function in the usual quantum-mechanical Hilbert space (a pure state). However, 
as we shall see, this effective purity may not be maintained in time. 

If p is pure in the usual sense, i.e., Trp 2 = 1, then the condition fll4]) holds for any 
observable, and therefore the resulting p is effectively pure. On the other hand, it is clear 
that the reduction of Eq. ( pT3|) is not one to one and therefore each p corresponds to an 
equivalence class of states in Liouville space. Even if only one of these states is pure, p 
would be effectively pure, since it does not distinguish between elements of the equivalence 



class. A more precise characterization of the effectively pure states can be found in Appendix 
A. It is easy to demonstrate that p(/3) is uniquely determined by the measurement of all the 
T-independent observables. We thus see that strict purity implies effective purity but not 
the opposite, i.e., even mixed states may appear as effectively pure. 

As an illustration, consider an unstable atomic state, which decays due to coupling with 
the electro-magnetic field. The unstable state itself, is a pure state, described by a well 
defined wave-function in the quantum-mechanical Hilbert space (which is an eigenfunction 
of the unperturbed atomic Hamiltonian) . As discussed in the introduction, the unitarity of 
the quantum evolution implies that the purity of the state is preserved, and its entropy is not 
changed. However, as we have just shown, there exist many mixed states which are identical 
to the unstable state from experimental point of view, since no accessible measurement (i.e., 
measurement of an observable which commutes with the atomic free Hamiltonian, such as 
the unperturbed energy or the angular momentum) can distinguish between these mixed 
state and the unstable pure state. These states were just defined as effectively pure. As we 
shall see, the coupling to the external field may, in general, induce mixing, i.e., the effectively 
pure states may evolve into effectively mixed states. This mechanism is demonstrated for a 
simple example later, and will be discussed elsewhere in the context of the unstable atomic 
state. 



We wish to show now that while unitarity excludes the possibility of mixing of pure 
states, mixing of effectively pure states (destruction of the effectively pure property) is still 
possible. Generally, in the presence of interaction, the full Liouvillian takes the form (from 



where the second term is, in general, not diagonal, but rather acts as an integral operator 
on £. Such an evolution generator was discussed recently in connection with the quantum 



IV. DYNAMICAL EVOLUTION 



(1) and (I)) 




(15) 
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Lax-Phillips theory [p5 |. The resulting evolution is also of an integral operator structure 
and takes the form 

P\ = j W ul {t)p%d^ (16) 

where the operator W^'(t) acts only on the (3 dependence. 
For simplicity we use the Fourier transform representation 

p{a,0) = f e-*°<ps((3)dZ; (17) 



W a , a ,{t) = J e-*<*e*'<*'W u ,{t)did£ . (18) 
Note that p({3) = p(a, /3)\ a=0 , and therefore 

p\(3) = p'(«,/3)| Q=0 = / W^{t-f3,f3')p{a\P')da'df3 ! . (19) 



The initial effective purity of p provides information only on its a = component while 
the other components may be even effectively mixed, but, as we see from Eq. (TiTS|), during 
the evolution the a = component develops contributions from the other components, and 
therefore it may become mixed. The states keep their effective purity, in general, only if 

We wish to consider now a simple concrete example to illustrate the above ideas. Con- 
sider the evolution of a particle in three dimensions in the presence of a screened Coulomb 
(Yukawa) potential. The matrix elements of the free Liouvillian are given by (we take 
2m = 1) 

(k 1 ,k 2 |£ |k 3 ,k 4 ) = 5 3 (k x -k 3 )5 3 (k 2 -k 4 )(k2 -k*) . (20) 

We change the variables in Liouville space from (ki, k 2 ) to (a, (3, Q±, f2 2 ) by the transforma- 
tion 

a = \4-\4, P = k 2 2 + kl (21) 
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and £li : Q,2 are the angle variables of the momenta ki,k 2 , respectively. We denote the set 
of variables (3, fli, f2 2 by (3. In this new basis the matrix elements of the free Liouvillian are 
given by 



(a, P\£o\a', p') = a5(a - a')5({3 - P') . 



(22) 



The variables a, ft defined by this change of basis coincide with the a,/3 of our general 
discussion above. 

As mentioned before, effectively pure states are mixed during the evolution unless 
W , a ' ~ d(a'). We therefore look at the evolution operators induced by the perturba- 
tion to see whether this is the case. The matrix elements of the interaction Liouvillian are 
given by 



(k l5 k 2 \d\k 3 , k 4 ) = 5 3 (kx - k 3 )^ k2 _ k4 - 5 3 (k 2 - k 4 )V kl _ k3 , 

where is the Fourier transform of the potential V, taken at the point k. 
For the screened Coulomb potential 

Ae~» r 



V(r) 



Vk is given by 



Vu = 



4nA 



Mk 2 + ^) 
and the matrix element takes the form 

4nA ( 5 3 (k! - k 3 ) 



(k 1 ,k 2 |£/|k3,k 4 ) = 



5 3 (k 2 -k 4 ) 



H V(k 2 -k 4 ) 2 + ^ 2 (k 1 -k 3 ) 2 + ^ 2 



Changing the variables to (a, (3), one obtains 



(a, (3\£i\a', p') = d(a, a', (3, p') 



6AnA 



5((3-a-f3' + a')-^= 6(n u Q 3 ) 

v/ /3— a -I 



^\p + P' + a + a f - 2yJ(P + a)(P' + a')B(n 2 , Ot) + 



6(P + a-0'-a 



r\ 1 



'P+a 



5(Q 2 , &4 



(P + P'-(a + a') - 2yJ(P-a)(P'-a')B(Sl 1 , Q 3 ) + fi 2 
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(23) 



(24) 



(25) 



(26) 



(27) 



where S(f2i,f2 2 ) is defined by 

B(Qx , Q 2 ) = sin 9\ sin 6> 2 cos(0i — 02 ) + cos 6*i cos #2 . (28) 

It is therefore clear that the kernel Cj(a, a', (3, (3') is not of the form 5(a — a')A(/3, f3') 
and therefore the evolution operators do not have this form either. In particular, for weak 
interactions, first order perturbation theory gives 

W , a {t) (3, (3') = 6(a)5(f3 - (3') - itd(0, a, (3, (3') + 0(t 2 A 2 ) , (29) 

where the second term induces mixing. 

We have shown that no mixing occurs if the unperturbed Liouvillian is non-degenerate 
(see Appendix A), and the result shows that no mixing occurs for the free motion. We 
do not yet have a general classification. 



V. ENTROPY 

We next define the notion of entropy for the effective states and show that this entropy 
is not constant during the motion as in traditional quantum (and classical) mechanics. 

We now remark that since, according to Eq. (§), the density operator in (£,/?) represen- 
tation can be written as 

Pt({3) = J K(0,f3\k,k')e-^- E ^p(k,k>), (30) 

one obtains 

p{(3) = J dZpM = 2irJ K(0, (3\k, k')5(E k - E k ,)p(k, k'). (31) 

The necessary and sufficient condition for a state to be effectively pure, as pointed out in 
Appendix A, is that the function p(k, k') be factorizable in the equal energy subspaces. 
The entropy of a quantum system, defined as 

S = -Tip\np (32) 
11 



to satisfy the requirements of convexity and additivity, vanishes for a pure state, i.e., a 
density operator of the form p = where the norm squared is unity. We 

therefore define the entropy of the effective state as the sum of entropies associated with 
p(k, k') in each energy subspace, i.e., with the reduced operator 

p = J dkdk'S(E k - E k ,)p(k,k')\k}(k'\. (33) 

For simplicity, we defer to Appendix B all the precise mathematical details required for 
the above reduction, and state here only the result 

S = J dES E = - J dE Trp E In p E . (34) 

where pE is the (normalized; see App. B) density matrix restricted to the E'-energy subspace. 
In case p(E, f2^; E, Qw) is factorizable, Se vanishes. Hence, for effectively pure p, where this 
factorizability condition holds for each equal energy subspace, the entropy is zero. However, 
in case p is not effectively pure, since S is convex, the admixture of non-factorizable elements 
inside the equal energy subspaces (as induced by the evolution (P^fl) induces an increase of 
entropy. One therefore sees that the entropy is increased in course of the evolution for a 
general effectively pure initial state unless it is a strictly pure state, i.e., described by a 
wave-function, whose entropy is constant. We do not study here the conditions under which 
the entropy increases given some non-zero entropy initial state. 



VI. CONCLUDING REMARKS 

We have shown that the class of observables which are constants of the free motion 
determine a reduced density matrix which, even when the original density matrix of the 
system corresponds to a mixed state, may be effectively pure. Such states correspond to 
an equivalence class which include, therefore, both pure and mixed states. An equivalence 
class of effectively pure states contains only pure states if and only if it is non-zero in only 
one energy subspace; due to the trace condition, such an equivalence class can be realized 
on discrete spectrum. 
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Under the evolution of the system, an effectively pure state may become effectively mixed, 
i.e., the elements in equal energy subspaces may become non-factorizable. We have defined 
the entropy of such a system which vanishes for an effectively pure state. We have shown 
that the system may evolve from any initial effective state to an effective state for which 
the entropy has changed. In particular, if the initial state is effectively pure, evolution can 
lead to an effectively mixed state with non-vanishing entropy. The example of the screened 
Coulomb potential which we worked out here illustrates this effect, and furthermore shows 
explicitly that the free evolution does not change the entropy. 

The method that we have described above applies as well to the formulation of classical 
mechanics on a Hilbert space defined on the manifold of phase space which was introduced 
by Koopman |26j and used extensively in statistical mechanics [[| . M isra |17j has shown that 
dynamical systems which admits a Lyapunov operator necessarily have absolutely continuous 
spectrum; therefore one can construct a time operator on the classical Liouville space for such 
systems. We identify the variables k, k' with the variables of the classical phase space, and 
consider the trace as an integral over this space. The expectation value of a ^-independent 
operator defines a reduced density function in the form (|T3|). Since a pure state is defined 
by a density function concentrated at a point of the phase space, a state which is effectively 
pure must have the form p(/3) = 5((3 — fio). The equivalence class associated with this 
reduced density contains mixed states as well, such as = 5{(3 — Po)f(0 corresponding 

to a non- localized function on the phase space (k, k'). The structure of the theory, and the 
conclusions we have reached, are therefore identical to those of the quantum case. 



13 



APPENDIX A 



In this appendix we intend to characterize an effectively pure state more explicitly. Since 
a is the Fourier dual of the variable £, which is the spectrum of the T-operator, it follows 
from (|^) that a is the spectrum of the unperturbed Liouvillian Co, the canonical conjugate of 
T. Hence, the a = component of a state / dkdk'c(k, k')|k)(k'|, for a basis {|k)} which are 
(generalized) eigenfunctions of Hq with (generalized) eigenvalues E^, is the partial integral 
over the terms for which the unperturbed Liouvillian vanishes, i.e., E^ = E^i. 

For a pure state corresponding to if) = J a(k)|k), c(k, k') = a(k)a(k')* is factorizable. An 
effectively pure state is a state which has the same reduced density matrix p as some pure 
state. Since this reduction is given by taking the a = component of p(a, f3), it follows that 
the a = component of an effectively pure state coincides with the a = component of a 
pure state, and therefore satisfies this factorizability condition in the equal energy subspaces. 
On the other hand, this condition in the equal energy subspaces does not imply its general 
validity (for a^O). Hence, an effectively pure state is associated with an equivalence class 
which includes mixed states as well. 

As an example, note that the mixed state 

p = J dEdE'p(E,E')\<p E )(<p E ,\, (Al) 

where p(E,E') is a positive kernel, / dEp(E,E) = 1, and the generalized states \4>e) cor- 
respond to normalized elements of He (and for which Hq is a multiplication operator), is 
effectively pure. 

If H is nondegenerate, the effective purity condition holds trivially for every state (diag- 
onal elements of the density matrix in Hq representation are positive definite), and, with the 
mechanism we propose, the evolution cannot induce mixing. Note that for classical systems, 
this condition implies that the system is integrable. 
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APPENDIX B 



In this appendix we describe the formal mathematical reduction of the density matrix 
into the equal energy subspaces. To extract the density operator associated with each equal 
energy subspace, we define the projection density 

P E = J dk5(E-E k )\k)(k\, (Bl) 

and carry out the operation 

P E p = J dkdk'5(E - E k )S(E k - E k ,)p{k, k')|k)<k'|. (B2) 

This operator is well defined; writing dk = dE k dQ k , where Q k is the degeneracy manifold 
associated with E k , one obtains 

P E p = J dn k dn k ,p(k,k')\ E=Ek=Ekl \EQ k )(EQ k ,\. (B3) 

The trace of this operator on the full Hilbert space does not exist (a well-known problem 
associated with continuous spectrum, and related to the Van Hove singularity arising from 
the fact that the equilibrium state for the unperturbed evolution is not an element of the 
Hilbert- Schmidt space). We therefore consider the foliation 

H = L 2 (R,H E ), (B4) 

with Lebesgue measure on R, and for which He corresponds to the degeneracy subspace at 
each E (pointwise). For / e 7i, the norm in this foliation is defined as 

ll/ll 2 = / WfE\\ 2 HE dE, (B5) 

or in terms of the original manifold {k}, 

J \\f E \\ 2 H E dE = J \f(E,n E )\ 2 dEdn E = J \f(k)\ 2 dk. (B6) 

The trace Tr# restricted to TC E then corresponds to a trace over the degeneracy subspace 
alone. For the operator (p3|). 

15 



Tr E P E p = J p(k, k)\ E=Ek dQ k . (B7) 

Note that 

J dETr E P E p = J p(k, k)\ E=Ek dEdQ k = I. (B8) 

We define, however, 

\ E = Ti E P E p (B9) 

so that 

Pe = ^-PeP (BIO) 

A E 

is a (dimensionless, normalized) operator in the Hilbert space TL E with representation 

p E = J dn k dn k , P (E,n k ;E,n k ,)\En k }{En k ,\. (bh) 

The entropy is then defined as 

S = J dES E = - J dE Tr p E \np E . (B12) 
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